Fluctuation theorems in general stochastic processes with odd-parity variables 
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We show that the total entropy production in stochastic processes with odd-parity variables (un- 
der time reversal) is separated into three parts, only two of which satisfy the integral fluctuation 
theorems in general. One is the usual excess entropy production, which can appear only transiently 
and is called nonadiabatic. Another one is attributed solely to the breakage of detailed balance. The 
last part not satisfying the fluctuation theorem comes from the steady-state distribution asymmetry 
for odd-parity variables, which is activated in a non-transient manner. The latter two contribu- 
tions combine together as the house-keeping (adiabatic) entropy production, whose positivity is not 
guaranteed except when the excess entropy production completely vanishes. 

PACS numbers: 05.70.Ln, 02.50.-r, 05.40.-a 
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The (integral) fluctuation theorem (FT) [l|-|5| can be 
stated for a variable lZ r (or 1Z in brief) assigned to a 
random sequence of states (or event) r |fj( as 



<e"*> = 5> r e-* = 1, 



(1) 



where V r is the probability of a sequence r. As a corol- 
lary, the Jensen's inequality guarantees (TV) > 0. Con- 
sider r as a path or trajectory in state space, gener- 
ated during a time interval by a stochastic dynamics. 
In case when its functional 1Z [7j represents the total en- 
tropy production during the process, the FT has been 
derived for various nonequilibrium(NEQ) processes, and 
the thermodynamic 2nd law (AS to t) > automatically 
follows 1,1,1). 

More recently, Hatano and Sasa found that a part of 
the total entropy production (excess entropy), AS ex , also 
satisfies the FT, which represents the entropy production 
associated with transitions between steady states 0, ■ 
Later, Speck and Seifert showed that the remaining part 
(house-keeping entropy), AShk, also satisfies the FT, 
which is required to maintain the NEQ steady state 
(NESS) [HI, EH. In case of (quasi-static) reversible pro- 
cesses, the system stays at equilibrium almost always 
during the process, then the house-keeping entropy pro- 
duction vanishes, AS^ = 0. Most recently, Esposito 
et. al. [f| interpreted the house-keeping entropy as an 
adiabatic part and the excess entropy as a nonadiabatic 
part of the total entropy production, through a time-scale 
argument. 

Most of findings about the FTs so far hold only when 
all state variables have even parity under time rever- 
sal, such as position variables. A typical example is 
the driven Brownian motion in the over-damped limit. 
Including odd-parity variables, such as momentum, the 
mathematical description becomes more complicated in 
particular for NEQ processes. Recently, Spinney and 
Ford suggested a separation of the total entropy pro- 



duction into three terms for the stochastic system with 
odd-parity variables [13j . The excess entropy production 
can be cleanly separated out (in fact, exactly the same 
as in the case with even-parity variables only) and it sat- 
isfies the FT. However, the house-keeping part composes 
of two different terms and only one term satisfies the FT. 
Especially, the other term not satisfying the FT turns out 
to be transient, which seems inconsistent with the usual 
adiabatic feature of the house-keeping entropy. Thus, it 
was concluded that the physical interpretation of sepa- 
rated entropies is not as clear as in the even- variable only 
case (adiabatic vs nonadiabatic), which needs further un- 
raveling. 

In this Letter, we present a new scheme of separation 
for the total entropy production when odd-parity vari- 
ables are included. In our scheme, the total entropy 
production is separated into the house-keeping and ex- 
cess contributions, which correspond to the adiabatic and 
nonadiabatic ones, respectively. The house-keeping (adi- 
abatic) contribution is composed of two non-transient 
characteristic terms, ASbDB and AS as , representing pre- 
cisely the detailed balance (DB) breakage and the steady 
state distribution (SSD) asymmetry for odd-parity vari- 
ables, respectively. It is clear that each term is adiabatic 
with different physical origins. For reversible processes, it 
is necessary to require both the DB and the SSD symme- 
try. Violation of either one brings about non-vanishing 
house-keeping entropy production and the processes be- 
come irreversible even in the steady state. The first term 
ASbDB obeys the FT, while does neither the second AS as 
nor their sum AShk = ASbDB + AS as - The nonadiabatic 
(excess) part AS ox is the same as in the even-variable 
only case, which satisfies the FT and so does the total 
entropy AS tot = AS hk + AS CX . 

A stochastic process can be described by the master 
equation 



(2) 
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FIG. 1: Schematic of a sample path x(t) and its time- 
reversed path x(r — t). The horizontal axis represents time 
t with to = and tjv+i = t. The vertical represents state a; 
in the upper and time-reversed state ea; in the lower. There 
are two time indices. Index i is used for N jumping processes 
between different states at times {ti, . . . , tiv}- j is used for 
the time-discretized version such as t = jAt (j — 1, . . . , M) 
with r = (M + l)At in the At -> limit. Note that Xi is the 
state kept unchanged during a time interval from U to 



where p x (t) is the probability distribution of state x at 
time t, and oj x>v is the transition rate from y to x for 



E 



,(< 0). x represents a 



x ^ y with <jj, i9 = 

state vector (si, S2, ■ ■ •) where each component Sk repre- 
sents a state variable with a definte parity, = 1 (even) 
or efe = — 1 (odd) under time reversal. The time- reversed 
state is given by ex = (eifii, £2S2, • ■ •)■ A(i) denotes a 
time-dependent protocol as a set of external control pa- 
rameters. 

Figure Q] shows a path x(t) generated by the master 
equation with the transition rate matrix u = {w x ,y} dur- 
ing t = to t, and its time-reversed path x(f) defined as 
ex(r— t). We assume that there are N jumping processes 
between different states at times {t±, . . . , tpj}. Then the 
probability functional of the "forward" path x(t) reads 



fN-l 



(Ai+i) 



\ i=0 



(3) 



where p Xo is the probability distribution of initial state 
xq, Xi is the state for U < t < and = X(U). The 
time-reversed process is considered under the protocol 
changes of X(t) — > A(r — t), and the initial probability 
is chosen as the final probability of the forward process, 
p XN . After a proper rearrangement (see Ref. @, [l3| for 
details), the probability functional of the "reverse" path 



x(t) reads 
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dto e „ 4 ,« 11 , i (X(t)) 



(Ai+i) 



i=0 
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r(A(t)) 



(4) 



We remark that Eqs. ([3]) and ((4]) have the same nor- 
malization factor since both include the same number of 
jumping processes. 

The path-dependent total entropy production, 
AStot[x], is the measure of the irreversibility of a path 
x with respect to its time-reversed path x, which can be 
defined as the associated path probability ratio fll. 12|: 



AStot M = In ; 



(5) 



Note that AStot is a FT functional since it satisfies 
Eq. ©; (e~ As ^) = ^ x ^[x]e" AS - = ^^[x] = 1 
(Jacobian \dx/dx\ = 1). If there are only even-parity 
variables (all = 1), the exponential factors of staying 
probabilities in Eqs. and (Q| are identical. These fac- 
tors are completely canceled out in the probability ratio, 
and thus only transition rates matter in AStot- However, 
it does not work in that way when odd-parity variables 
are included, and this is a main source of mathematical 
difficulty and also different physical origins. 

It is convenient to express the path probability by the 
conditional probability for transition from y to x during 
discretized unit time At (Fig. [TJ, given as 

r Xl v(A(t)) = 8 x , y + cj x , y (X(t))At (6) 

where 5 x>y is the Kronecker delta valued 1 for x = y 
or otherwise. At is chosen small enough to maintain 
Tx.x > 0. Then the two path probabilities can be written 

as 



'VrM = p X0 Uf=i r x +, x j ( a j) > 
_7>r[x] = Pxn YlT=i T cx T, ex +( X i) . 



(7) 



where x~j and x~ represent states just after and be- 
fore time t = jAt respectively and Xj = X(jAt). Note 
that the product therein includes the staying processes of 
x~j = xj as well as the jumping processes. Using Eq. (J7J, 
one simply writes AStot as 



ASt„t = AS - 



A/ p 

£ ln F 

3=1 



ex - ,ex 



(8) 



where AS = —h\{p XN /p Xo ) is the entropy change of the 
system for the forward path. We will later take the At — > 
limit to come back to the original problem. The explicit 
path dependence of the entropy production is dropped 
just for simplicity. 
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The breakage of the DB is an essential characteris- 
tics of nonequilibrium processes, which leads to entropy 
production even in the NESS. Thus, it would be use- 
ful to search for a separation scheme to isolate the en- 
tropy production due to the DB breakage only. The 
generalized (instantaneous) DB condition at time t for 
stochastic processes with odd-parity variables is given 
as w x ,y(\(t))p s y (\(t)) = cj ey>ex (X(t))p s ex (X(t)) for x ^ y 
where p x (X(t)) is the SSD of state x for a constant pro- 
tocol A, whose value is given by A(i), satisfying the 
steady state equation J2 X ^ v ,x(X)p s x (X) = 0. This con- 
dition guarantees no physical average currents between 
states in the steady state and also yields a relation re- 
garding to the diagonal elements as oj XiX (X(t))p x (X(t)) = 
w ea; , ea; (A(i))f4.(A(i)), using u x<x = -J^y^x^y^ • In 
terms of the conditional probabilities, the generalized DB 
condition thus reads as 



r«,„(A(t)) 



t (A(t)) 



pix(Ht)) 
p y (Ht)) 



ptx(Kt)) 

PS(A(f)) 



— 0~x,y 
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ey,ex 



(A(*)) 



ptx(Kt)) 
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(9) 



We propose the adjoint stochastic process with T' 



x.ti 



that can be used to provide a precise measure of the 
broken DB as 



Tl y (X(t)) = S x , y + ul v (X(t))At 



with 



Ek 
Pi 



(10) 



(ii) 



It is trivial to show that is stochastic with sufficiently 
small At 0: J2 X T l,y = 1 and T ly > for a11 V- 

When r£ = T x<y , the DB is satisfied. The entropy 
production due to the DB breakage, ASdDB, can be de- 
fined as 



AS bDB = 2_j ln = In ■ 



(12) 



Now subtracting ASbDB from AStot, one can write the 
remaining part, AS" = AStot — ASbDB as 



AS" = In ^S. 

Px N 



M 

E 



ln „ J ' J ; , (13) 



(Aj) ' 



which is not a FT functional in general, because it is 
not guaranteed to write down AS' = ln'Pr[x]/'Pr"[x / ] 
for the probability functional "Pr"[ x '] of (reverse) path 
x' in a stochastic dynamics with a certain conditional 
probability V . One can find the stochastic condition for 

^y,x = ^x,y^ey,ex/^ x ,y aS 



E 



r: 




(14) 



This shows that V is in general not stochastic due to e 
mismatch (note that T x x also includes e) . Exceptions 
when p x = p\ x or rj. x = T xx will be revisited later. 

We can instead extract the excess entropy part by in- 
troducing another stochastic process with r* (exactly 
the same one as in the even-variable only case) as 



T* XiV (X(t)) = 6 x>y + u* Xty (X(t))At 



with 



Pi 



(15) 



(16) 



Now, we define the excess entropy production, AS 0X , as 



AS c: 



i n ££iL + y ln 

Px, ^ 



r x t )X r(Aj) 

J ' J 

-(A,) 



hi 



Pr.[*] 



M 

AS + J2 ln 



P 



(17) 



where the path for the T* process is given by x(t) = 
x(t— t) (time- reversed without parity change). Of course, 
AS ex is again a FT functional, satisfying the integral FT. 

The remaining part, AS as = AS to t - AS b DB - AS ex , 
can be written as 



where V r \ [x] = p Xo Yl^Li ^ + - (Aj) is the probability of 

the forward path x by the adjoint dynamics. ASbDB is 
a FT functional by itself, satisfying the integral FT and 
must belong to the house-keeping entropy production, 
since it contributes even in the steady state. It also sat- 
isfies the detailed FT: P(R)/P*(-R) = e R , where P(R) 
is the probability that ASbDB = R in the original process 
while P^ is its counterpart in the adjoint process. This 
is because the mapping to the adjoint dynamics is invo- 
htive (rtt = T) @, since both the original and adjoint 
dynamics share the same SSD (p x = p x s ). 
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PU T ex+,ex+ 



(18) 



One can show easily that this part does not satisfy the 
FT except vanishing when there is a SSD symmetry as 



p: 



Pa 



(19) 



between mirror (opposite-parity) states. This asymmet- 
ric entropy production term is present even in the ab- 
sence of external driving X(t) and also in the NESS 
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(clearly not transient), so must belong to the house- 
keeping entropy production. It therefore follows 



AS tl 



AS CX + AS; 



hk 



(20) 



with AShk = ASbDB+ASas, identified as the total house- 
keeping entropy production, which does not obey the FT 
in general. 

The house-keeping entropy production should vanish 
in the reversible (equilibrium) processes, which implies 
that the equilibrium (EQ) condition requires not only the 
DB but also the symmetry between the SSD of the mirror 
states, when odd-parity variables are involved. These two 
conditions are independent, and our two house-keeping 
contributions, AS'bDB and AS as , measure precisely the 
violation of these two EQ conditions, respectively. 

It is worthy of noting that AS'bDB and AS as steadily 
contribute to AS'tot in the adiabatic process (or even at 
A = 0) where the time scale of A(t)-changc is much larger 
than the relaxation time. This time scale argument is the 
reasoning behind the classification of adiabatic and non- 
adiabatic contributions in AS'tot, proposed in Ref. @. In 
this criterion, both ASbDB and AS as are the adiabatic 
contributions while AS' ox is the non-adiabatic one. So 
the total house-keeping entropy production comprising 
of ASbDB and AS as is the only and full adiabatic contri- 
bution to the total entropy production. 

In the At — > (i.e., M — > oc) limit, one can obtain 



AS CX = ln^+]Tln 



Px N j~[ Pl^iKU)) 



(21) 



AS\ k = / dt ( (A(t)) (AW)) 

y^ ln ^,.x,_ 1 (A(^)K._ 1 
,exi—i 

N rU+i 

AS'bDB - / *Ki.Xi(A(*))-<4 t , Xt (A(t))) 

v^. Wii,ii_i(A(t.)) 

+ zJ n ;T 



(22) 



(23) 



N 



PL (AW) 



AS'bDB represents the contribution solely responsible 
for the DB breakage, which is the total house-keeping 
entropy in the absence of odd-parity variables. While a 
similar contribution was found by Spinney and Ford (l3j , 
their term contains what is not directly related to the 
broken DB. In the meantime, AS* as is an odd- variable 
specific term. It characterizes the asymmetry in the SSD 



for mirror states. Thus, the asymmetric entropy pro- 
duction serves as another important quantity to measure 
the irreversibility of noncquilibrium processes that has 
not been deeply investigated in the literature. Its im- 
portance has recently been recognized by Spinney and 
Ford [13J, but their term only exists transiently. In our 
work, AS as is shown to exist steadily even for A = 0. 

We briefly mention on the exceptional cases observed 
in Eq. (fl"4|). where the total entropy production can be 
divided into two terms, each of which satisfies the FT. 
Particulary we consider the case in which rj, x = T XiX 
(the other case of p s ex = p s x leads to the conventional 
separation by AS as = 0). The condition gives a new 



stochastic process r' , distinct from T* x in Eq. ([15 
Then, one readily finds a new separation as 



AS t , 



AS- 



bDB 



AS n 



(25) 



where AS m i X = AS ex + AS as also satisfies the FT. In the 
light of physical origin, AS as belongs to the adiabatic en- 
tropy production. From the mathematical point of view, 
however, it operates with nonadiabatic AS ex . Moreover, 
in the adiabatic limit, we have AShk only, which can be 
cleanly separated into two FT functionals. It will be an 
interesting study to find an example of this exception. 
Finally, we comment on the intriguing feature of T' in 



Eq. (|T0| . This is the generalization of the adjoint process 
in the even- variable only dynamics (jl. [ToL Hlj|. However, 
r£ x = 1 + uj eXiex (At)p s ex /p x may become negative for a 
finite At when p s ex ^ p s x . This situation may be realized 
when a finite At is used as a model parameter or in nu- 
merical study of continuous-time models. In this case, 
At smaller than that used to introduce the original T is 
required to make be a stochastic process. If not ful- 
filled, AShk (or AS a ) can not be divided into ASbDB and 
AS as . There thus exists a upper bound of At to generate 
such an entropy production that is generic to the system 
of interest. The related implication needs further study. 
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